[031 8] What is claimed is: 



1 1. A computer-implemented method of discovering relationships between 

2 items, comprising: 

3 accepting item selections from a plurality of users; 

4 generating a log for each user, each log containing identifiers for the user's 

5 item selections; 

6 accepting a query including at least one query item identifier; 

7 scoring the user logs, responsive to a degreepf occurrence of the at least 

8 one query item identifier in the user logs, to generate user log 

9 scores; and 

io determining at least one result item, responsive to a degree of occurrence 

n in at least a subset of the scored user logs. 

1 2. The computer-implemented method of claim 1, wherein a significance 

2 of the occurrence is determined by a log likelihood ratio analysis and the deter- 

3 mined result is responsive to the determined significance. 

1 3. The computer-implemented method of claim 1, wherein a significance 

2 of the occurrence is determined by a substantial equivalent of a log likelihood 

3 ratio analysis and the determined result is responsive to the determined signif i- 

4 cance. 
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4. The computer-implemented method of claim 1, wherein each item is a 
video track and wherein accepting item selections comprises determining which 
tracks are selected for playback. 

5. The computer-implemented method of claim 1, wherein each item is a 
music track and wherein accepting item selections comprises determining which 
tracks are selected for playback. 

6. The computer-implemented method of claim 5, further comprising: 
generating a track list containing an identifier for each determined result 

item comprising a music track. 

7. The computer-implemented method of claim 6, further comprising: 
deleting from the track list at least one identifier corresponding to a music 

track already selected by the user. 

8. The computer-implemented method of claim 6, further comprising: 
playing the music tracks specified by the generated track list. 

9. The computer-implemented method of claim 5, further comprising: 
accepting a format schedule specifying music track categories for time pe- 
riods; and 
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4 generating a track list conforming to the format schedule and containing 

5 an identifier for each determined result item comprising a music 

6 track. 

1 10. The computer-implemented method of claim 5, wherein scoring the 

2 user logs comprises determining a degree of occurrence in each user log of at 

3 least one music track identified by the query item identifier. 

1 11. The computer-implemented method of claim 5, wherein scoring the 

2 user logs comprises determining a degree of occurrence in each user log of at 



3 least one music track associated with an artist identified by the query item identi- 

4 fier. 

1 12. The computer-implemented method of claim 1, wherein accepting item 

2 selections comprises receiving input provided by a user via a web page. 

1 13. The computer-implemented method of claim 1, wherein accepting item 

2 selections comprises receiving input specifying an item purchase by a user. 

1 14. The computer-implemented method of claim 1, further comprising, 

2 prior to determining the at least one result item, defining the subset of the scored 

3 user logs responsive to the user log scores. 



-97- 



Case 4647 

22227/04647/DOCS/1056695.6 



• 



1 15. The computer-implemented method of claim 1, further comprising: 

2 monitoring user behavior with respect to the selected items; and 

3 adjusting the user log responsive to the monitored user behavior. 

1 16. The computer-implemented method of claim 15, wherein monitoring 

2 user behavior comprises at least one selected from the group consisting of: 

3 detecting user input requesting that a selected item be repeated; 

4 detecting user input requesting that a selected item be skipped; 

5 detecting user input specifying a volume change; and 

6 detecting user input specifying that a selected item be muted. 

1 17. The computer-implemented method of claim 1, wherein accepting item 

2 selections comprises receiving input provided by a user via an application for 

3 playing tracks. 

1 18. The computer-implemented method of claim 1, wherein accepting a 

2 query comprises receiving a user log containing identifiers for a user's item selec- 

3 tions. 

2 19. The computer-implemented method of claim 1, wherein accepting a 

2 query comprises receiving a first search term, the method further comprising: 
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generating a second search term containing an identifier for each deter- 
mined result item. 

20. The computer-implemented method of claim 19, further comprising at 
least one of: 

providing the second search term as input for a search engine; and 
adding the second search term to a searchable portion of a document as- 
sociated with the first search term. 

21. The computer-implemented method of claim 1, further comprising: 
periodically uploading the generated log. 

22. The computer-implemented method of claim 1, further comprising: 
outputting an advertisement relating to the determined at least one result 

item. 

23. The computer-implemented method of claim 22, wherein outputting 
an advertisement comprises displaying at least one selected from the group con- 
sisting of: 

a web page; 
a banner; 

a portion of a web page; and 
an animation. 
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24. The computer-implemented method of claim 1, further comprising: 
outputting a notification relating to the determined at least one result 

item. 

25. The computer-implemented method of claim 24, wherein outputting a 
notification comprises displaying a web page. 

26. The computer-implemented method of claim 24, wherein outputting a 
notification comprises sending a communication to a user. 

27. The computer-implemented method of claim 26, wherein sending a 
communication to a user comprises at least one selected from the group consist- 
ing of: 

transmitting an electronic mail message to the user; 

telephoning the user; and 

sending a direct mail item to the user. 

28. The computer-implemented method of claim 1, wherein the deter- 
mined result is responsive to a significance of the occurrence of the item in at 
least a subset of the scored user logs, and wherein the significance is determined 
by a log likelihood ratio analysis submethod comprising: 

determining a total number of user logs N; 
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6 determining a number of user logs Ni in a subset of user logs; 

7 determining a number of user logs N2 not in the subset of user logs; 

8 determining a number of user logs kn in the subset that include the item; 

9 determining a number of user logs ki2 not in the subset that include the 

10 item; 

11 determining a number of user logs k2i = Ni - kn in the subset that do not 

22 include the item; 

23 determining a number of user logs k22 = N2 - ki2 not in the subset that do 
14 not include the item; 

25 and determining a log likelihood ratio for the item. 

2 29. The computer-implemented method of claim 28, wherein the log like- 
2 lihood ratio is defined as: 

4 where: 7 i iJ =^j-,n j = 

1 30. The computer-implemented method of claim 29, further comprising: 

2 adjusting at least one of the kij values responsive to at least one selected 

3 from the group consisting of: 

4 the number of occurrences of the item in a user log; 
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5 the logarithm of the number of occurrences of the item in a user 

6 > log; 

7 the number of occurrences of the item in all user logs; 

8 the logarithm of the total number of users divided by the number 

9 of users who have selected the item; and 
20 a normalizing factor. 

1 31. The computer-implemented method of claim 30, wherein the normal- 

2 izing factor is * = , where S* is a weight based on the number of occur- 

3 rences of the item in all user logs and W i} is a weight based on the number of oc- 

4 currences of the item in a particular user log. 

1 32. The computer-implemented method of claim 1, further comprising: 

2 deleting from the determined at least one result item any result items al- 

3 ready selected by a user associated with the query. 

1 33. The computer-implemented method of claim 1, further comprising: 

2 ranking the at least one result item responsive to the degree of signif i- 

3 cance. 

1 34. A computer-implemented method of discovering a relationship be- 

2 tween a first item and a second item, comprising: 
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determining a total number of item groups N; 


4 


determining a number of item groups Ni in a subset of item groups, the 


5 


subset of item groups being defined as including those item 


6 


groups that contain a second item; 


7 
8 


determining a number of item groups N2 not in the subset of item groups; 
determining a number of item groups kn in the subset that contain the 


9 


first item; 


10 


determining a number of item groups ki2 not in the subset that contain the 




first item; 


CO 

4--« 12 

cn 


determining a number of item groups k2i = Ni - kn m the subset that do 




not contain the first item; 


i.u 


determining a number of item groups k22 - N2 - ki2 not in the subset that 


S3 

«h 35 

|y 


do not contain the first item; 


S 36 


and determining a log likelihood ratio. 


3 


35. The computer-implemented method of claim 34, wherein the log like- 


2 


lihood ratio is defined as: 


3 


„ 71.. 


4 


where: rc„ = — , u . = Y — . 

Ng 1 
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36. The computer-implemented method of claim 35, wherein each item 
group comprises a document. 



37. The computer-implemented method of claim 35, further comprising: 
adjusting at least one of the kij values responsive to at least one selected 

from the group consisting of: 
the number of occurrences of the item in a document; 
the logarithm of the number of occurrences of the item in a docu- 
ment; 

the number of occurrences of the item in all documents; 

the logarithm of the total number of documents divided by the 

number of documents that include the item; and 
a normalizing factor. 

38. The computer-implemented method of claim 37, wherein the normal- 
izing factor is * = , where S . represents the number of occurrences of 

the item in all documents and W y represents the number of occurrences of the 
item in a particular document. 

39. A system for discovering relationships among items, comprising: 
a user interface for accepting item selections from a plurality of users; 
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at least one log database, coupled to the user interface, for storing a log for 
each user, each log containing identifiers for the user's item 
selections; 

a query input device for accepting a query including at least one query 
item identifier; and 

a recommendation engine, coupled to the log database and to the query 

input device, for scoring the user logs, responsive to a degree of 
occurrence, to generate user log scores, and for determining at 
least one result item, responsive to a degree of occurrence in at 
least a subset of the scored user logs. 

40. The system of claim 39, wherein the significance of the occurrence is 
determined by a log likelihood ratio analysis and the recommendation engine 
determines the at least one result item responsive to the determined significance. 

41. The system of claim 39, wherein the significance of the occurrence is 
determined by a substantial equivalent of a log likelihood ratio analysis and 
wherein the recommendation engine determines the at least one result item re- 
sponsive to the determined significance. 
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2 42. The system of claim 39, wherein each item is a video track and wherein 

2 the user interface accepts item selections by determining which tracks are se- 

3 lected for playback. 

1 43. The system of claim 39, wherein the user interface accepts item selec- 

2 tions by determining which tracks are selected for purchase. 

2 44. The system of claim 39, wherein each item is a music track and 

2 wherein the user interface accepts item selections by determining which tracks 

3 are selected for playback. 

2 45. The system of claim 44, wherein the user interface comprises an online 

2 jukebox. 



2 46. The system of claim 45, wherein the online jukebox monitors user be- 

2 havior with respect to the selected items and adjusts the user log scores respon- 

3 sive to the monitored user behavior. 

2 47. The system of claim 46, wherein the online jukebox monitors user be- 

2 havior by detecting at least one selected from the group consisting of: 

3 user input requesting that a selected item be repeated; and 

4 user input requesting that a selected item be skipped; and 
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5 user input specifying a volume change; and 

6 user input specifying that a selected item be muted. 

1 48. The system of claim 47, further comprising: 

2 a track list generator, coupled to the recommendation engine, for generat- 

3 ing a track list containing an identifier for each determined re- 

4 suit item comprising a music track. 

1 49. The system of claim 44, further comprising: 

2 a music player, coupled to the track list generator, for playing the music 

3 tracks specified by the generated track list. 

1 50. The system of claim 44, further comprising: 

2 a format scheduler, for accepting a format schedule specifying music track 

3 categories for time periods; and 

4 a track list generator, coupled to the recommendation engine and to the 

5 format scheduler, for generating a track list conforming to the 

6 format schedule and containing an identifier for each deter- 

7 mined result item comprising a music track. 

1 51. The system of claim 39, wherein the query input device receives a user 

2 log containing identifiers for a user's item selections. 
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52. The system of claim 39, wherein the query input device receives a first 
search term, the system further comprising: 

a search term generator, coupled to the recommendation engine, for gen- 
erating a second search term containing an identifier for each 
determined result item and for providing the second search 
term as input for a search engine. 

53. The system of claim 39, wherein the query input device receives a first 
search term, the system further comprising: 

a search term generator, coupled to the recommendation engine, for gen- 
erating a second search term containing an identifier for each 
determined result item and for providing the second search 
term to be added to a searchable portion of a document associ- 
ated with the first search term. 

54. The system of claim 39, further comprising: 

an advertisement output device, coupled to the recommendation engine, 
for outputting an advertisement relating to the determined at 
least one result item. 

55. The system of claim 54, wherein the advertisement output device dis- 
plays at least one selected from the group consisting of: 
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a web page; 
a banner; 

a portion of a web page; and 
an animation. 

56. The system of claim 39, further comprising: 

a notification output, coupled to the recommendation engine, for output- 
ting a notification relating to the determined at least one result 
item. 

57. The system of claim 56, wherein the notification output device displays 
at least one selected from the group consisting of: 

a web page; 
a banner; 

a portion of a web page; and 
an animation. 

58. The system of claim 56, wherein the notification output device sends a 
communication to a user. 

59. A computer-readable medium comprising computer-readable code for 
discovering relationships between items, comprising: 
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computer-readable code adapted to accept item selections from a plurality 
of users; 

computer-readable code adapted to generate a log for each user, each log 
containing identifiers for the user's item selections; 

computer-readable code adapted to accept a query including at least one 
query item identifier; 

computer-readable code adapted to score the user logs, responsive to a 
degree of occurrence of the at least one query item identifier in 
the user logs, to generate user log scores; and 

computer-readable code adapted to determine at least one result item, re- 
sponsive to a degree of occurrence in at least a subset of the 
scored user logs. 

60. The computer-readable medium of claim 59, wherein a significance of 
the occurrence is determined by a log likelihood ratio analysis and the deter- 
mined result is responsive to the determined significance. 

61. The computer-readable medium of claim 59, wherein a significance of 
the occurrence is determined by a substantial equivalent of a log likelihood ratio 
analysis and the determined result is responsive to the determined significance. 
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1 62. The computer-readable medium of claim 59, wherein each item is a 

2 video track and wherein the computer-readable code adapted to accept item se- 

3 lections comprises computer-readable code adapted to determine which tracks 

4 are selected for playback. 

1 63. The computer-readable medium of claim 59, wherein each item is a 

2 music track and wherein the computer-readable code adapted to accept item se- 

3 lections comprises computer-readable code adapted to determine which tracks 

4 are selected for playback. 

1 64. The computer-readable medium of claim 63, further comprising: 

2 computer-readable code adapted to generate a track list containing an 



3 identifier for each determined result item comprising a music 

si aw 



track. 



1 65. The computer-readable medium of claim 64, further comprising: 

2 computer-readable code adapted to delete from the track list at least one 

3 identifier corresponding to a music track already selected by the 

4 user. 

1 66. The computer-readable medium of claim 64, further comprising: 
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2 ' computer-readable code adapted to play the music tracks specified by the 

3 generated track list. 

1 67. The computer-readable medium of claim 63, further comprising: 

2 computer-readable code adapted to accept a format schedule specifying 

3 music track categories for time periods; and 

4 computer-readable code adapted to generate a track list conforming to the 

5 format schedule and containing an identifier for each deter- 

6 mined result item comprising a music track. 

l 68. The computer-readable medium of claim 63, wherein the computer- 



2 readable code adapted to score the user logs comprises computer-readable code 

3 adapted to determine a degree of occurrence in each user log of at least one mu- 

4 sic track identified by the query item identifier. 

1 69. The computer-readable medium of claim 63, wherein the computer- 

2 readable code adapted to score the user logs comprises computer-readable code 

3 adapted to determine a degree of occurrence in each user log of at least one mu- 

4 sic track associated with an artist identified by the query item identifier. 

2 70. The computer-readable medium of claim 59, wherein the computer- 

2 readable code adapted to accept item selections comprises computer-readable 

3 code adapted to receive input provided by a user via a web page. 
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71. The computer-readable medium of claim 59, wherein the computer- 
readable code adapted to accept item selections comprises computer-readable 
code adapted to receive input specifying an item purchase by a user. 

72. The computer-readable medium of claim 59, further comprising, com- 
puter-readable code adapted to, prior to determine the at least one result item, 
define the subset of the scored user logs responsive to the user log scores. 

73. The computer-readable medium of claim 59, further comprising: 
computer-readable code adapted to monitor user behavior with respect to 

the selected items; and 
computer-readable code adapted to adjust the user log scores responsive 
to the monitored user behavior. 

74. The computer-readable medium of claim 73, wherein the computer- 
readable code adapted to monitor user behavior comprises at least one selected 
from the group consisting of: 

computer-readable code adapted to detect user input requesting that a se- 
lected item be repeated; 

computer-readable code adapted to detect user input requesting that a se- 
lected item be skipped; 
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computer-readable code adapted to detect user input specifying a volume 
change; and 

computer-readable code adapted to detect user input specifying that a se- 
lected item be muted. 

75. The computer-readable medium of claim 59, wherein the computer- 
readable code adapted to accept item selections comprises computer-readable 
code adapted to receive input provided by a user via an application for playing 
tracks. 

76. The computer-readable medium of claim 59, wherein the computer- 
readable code adapted to accept a query comprises computer-readable code 
adapted to receive a user log containing identifiers for a user's item selections. 

77. The computer-readable medium of claim 59, wherein the computer- 
readable code adapted to accept a query comprises computer-readable code 
adapted to receive a first search term, the computer-readable medium further 
comprising: 

computer-readable code adapted to generate a second search term con- 
taining an identifier for each determined result item. 

78. The computer-readable medium of claim 77, further comprising at 
least one of: 



-114- 



Case 4647 

22227/04647/DOCS/1056695.6 



computer-readable code adapted to provide the second search term as in- 
put for a search engine; and 

computer-readable code adapted to add the second search term to a 
searchable portion of a document associated with the first 
search term. 

79. The computer-readable medium of claim 59, further comprising: 
computer-readable code adapted to periodically upload the generated log. 

80. The computer-readable medium of claim 59, further comprising: 
computer-readable code adapted to output an advertisement relating to 

the determined at least one result item. 

81. The computer-readable medium of claim 80, wherein the computer- 
readable code adapted to output an advertisement comprises computer-readable 
code adapted to display at least one selected from the group consisting of: 

a web page; 
a banner; 

a portion of a web page; and 
an animation. 

82. The computer-readable medium of claim 59, further comprising: 
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computer-readable code adapted to output a notification relating to the 
determined at least one result item. 



1 83. The computer-readable medium of claim 82, wherein the computer- 

2 readable code adapted to output a notification comprises computer-readable 

3 code adapted to display a web page. 

1 84. The computer-readable medium of claim 82, wherein the computer- 

2 readable code adapted to output a notification comprises computer-readable 

3 code adapted to send a communication to a user. 

1 85. The computer-readable medium of claim 84, wherein the computer- 

2 readable code adapted to send a communication to a user comprises at least one 
? : i 3 selected from the group consisting of: 

i : j 

p 4 computer-readable code adapted to transmit an electronic mail message to 

o 

5 the user; 

6 computer-readable code adapted to telephone the user; and 

7 computer-readable code adapted to send a direct mail item to the user. 

1 86. The computer-readable medium of claim 59> wherein the determined 

2 result is responsive to a significance of the occurrence of the item in at least a 

3 subset of the scored user logs, and wherein the computer-readable code adapted 

4 to determine a binomial log likelihood ratio for an item comprises computer- 
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readable code adapted to determine the result by a log likelihood ratio analysis 
submethod. 



87. The computer-readable medium of claim 86, wherein the computer- 
readable code adapted to determine the result by a log likelihood ratio analysis 
submethod comprises: 

computer-readable code adapted to determine a total number of users N; 

computer-readable code adapted to determine a number of users Ni in a 
subset of users; 

computer-readable code adapted to determine a number of users N2 not in 

the subset of users; 
computer-readable code adapted to determine a number of users kn in the 

subset that selected the item; 
computer-readable code adapted to determine a number of users ki2 not 

in the subset that selected the item; 
computer-readable code adapted to determine a number of users kn = Ni 

- kn in the subset that did not select the item; 
computer-readable code adapted to determine a number of users k22 = N2 

- ki2 not in the subset that did not select the item; and 
computer-readable code adapted to determine a log likelihood ratio for 

the item. 
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88. The computer-readable medium of claim 87, wherein the log likeli- 
hood ratio is defined as: 

Mj 

where: n u = = T — • 

89. The computer-readable medium of claim 59, wherein the computer- 
readable code adapted to determine the result by a log likelihood ratio analysis 
submethod further comprises: 

computer-readable code adapted to adjust at least one of the nij values re- 
sponsive to at least one selected from the group consisting of: 
the number of occurrences of the item in a user log; 
the logarithm of the number of occurrences of the item in a user 
log; 

the number of occurrences of the item in all user logs; 

the logarithm of the total number of users divided by the number 

of users who have selected the item; and 
a normalizing factor. 
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90. The computer-readable medium of claim 89, wherein the normalizing 
factor is * = , where 5 , is a weight based on the number of occurrences 

of the item in all user logs and W i} is a weight based on the number of occur- 
rences of the item in a particular user log. 

91. The computer-readable medium of claim 59, further comprising: 
computer-readable code adapted to delete from the determined at least 

one result item any result items already selected by a user asso- 
ciated with the query. 

92. The computer-readable medium of claim 59, further comprising: 
computer-readable code adapted to rank the at least one result item&e- 

sponsive to the degree of significance. 

93. A computer-readable medium comprising computer-readable code for 
discovering a relationship between a first item and a second item, comprising: 

computer-readable code adapted to determine a total number of item 
groups N; 

computer-readable code adapted to determine a number of item groups 
Ni in a subset of item groups, the subset of item groups being 
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7 defined as including those item groups that contain a second 

8 item; 

9 computer-readable code adapted to determine a number of item groups 
io Ni not in the subset of item groups; 

u computer-readable code adapted to determine a number of item groups 

12 kn in the subset that contain the first item; 

13 computer-readable code adapted to determine a number of item groups 

14 ki2 not in the subset that contain the first item; 

25 computer-readable code adapted to determine a number of item groups 

16 k2i = Ni - kn in the subset that do not contain the first item; 

17 computer-readable code adapted to determine a number of item groups 

18 k22 = N2 - ki2 not in the subset that do not contain the first item; 

19 and 

20 computer-readable code adapted to determine a log likelihood ratio. 

1 94. The computer-readable medium of claim 93, wherein the log likeli- 

2 hood ratio is defined as: 

k.. k-- 

4 where: n u = —,U: = Y — . 

" 7 i N 



-120- 



Case 4647 

22227/ 04647/ DOCS/1 056695.6 



95. The computer-readable medium of claim 93, wherein each item group 
comprises a document. 



96. The computer-readable medium of claim 93, further comprising: 
computer-readable code adapted to adjust at least one of the kij values re- 
sponsive to at least one selected from the group consisting of: 

the number of occurrences of the item in a document; 

the logarithm of the number of occurrences of the item in a docu- 



a normalizing factor. 



97. The computer-readable medium of claim 96, wherein the normalizing 



ment; 



the number of occurrences of the item in all documents; 



the logarithm of the total number of documents divided by the 



number of documents that include the item; and 



factor is 




, where S - represents the number of occurrences of the item 



in all documents and W i} represents the number of occurrences of the item in a 



particular document. 
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